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Abstract: In the last 20 years, teacher preparation programs have come under close scrutiny by the 
public and governmental agencies charged with monitoring teacher quality and the academic achievement 
of American students. Both regular and special education teacher preparation programs struggle with the 
requirement to collect valid and reliable evidence of teacher candidate performance and their effect on 
student learning. This study incorporated an ecobehavioral assessment tool (MS-CISSAR) in the evaluation 
of 13 special education teacher candidates during their internship experiences. Special education teacher 
candidates taught in deaf education classrooms and self-contained and resource rooms for students with 
disabilities. Results showed that the instructional arrangements, teaching behaviors and student responses 
were similar to studies using inservice teachers and students with disabilities as subjects. The incorporation 
of data gathered through the MS-CISSAR program could be used to meet university and NCATE require- 
ments for evidence of teacher candidate performance. 


I n today’s political climate, teacher instruc- 
tion and student achievement are often 
seen as two sides of the same coin. If teachers 
do their job, students will achieve. If students 
do not achieve, then teachers are not doing 
their job. Although many educators balk at 
the simplistic explanation, public opinion is 
clear. Sixty-eight percent of Americans be- 
lieved that every state in America should re- 
quire a nationally standardized test to mea- 
sure student achievement. Fifty-three percent 
favored using a single test to determine stu- 
dent promotion to the next grade. Fifty-sev- 
en percent supported a test to determine if 
students should graduate from high school 
(Rose & Gallup, 2002). 

The public is not off the mark in their 
demands for teachers who can demonstrate 
educational excellence in the classroom. 


Qualified teachers have a significant impact 
on student learning (see Darling-FIammond, 
2000). What teachers know and what teach- 
ers can do in the classroom have significant 
influence on what students learn (National 
Commission on Teaching and Americas Fu- 
ture, 1996). With that knowledge in the 
minds of educational policymakers in Amer- 
ica, high-stakes testing and teacher account- 
ability are inextricably intertwined. Unfor- 
tunately, many schools, teachers, and teacher 
preparation programs remain unprepared to 
deliver the quality of educational excellence 
demanded by the public. 

Expectations of accountability have 
changed in the last few years. Teachers have 
responded in a variety of ways. Some teach- 
ers strive to improve their use of instructional 
strategies considered “best practice” by re- 
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searchers (Vogler, 2002) while teachers la- 
ment the atrophy of their creative talents. 
Many teachers simply leave the field (Tye & 
O’Brien, 2002). Accountability pressures 
have filtered down to teacher candidates. In 
a study of what teacher candidates fear most 
about their first year of teaching. Gee (2001) 
found that 45% of the teacher interns indi- 
cated fears around “accountability” (i.e., 
planning and implementing state standards 
and the state-mandated assessment test). 

Teacher candidate fears around account- 
ability may in part, stem from perceived 
weaknesses in teacher training programs. The 
U.S. Secretary of Education, in the Annual 
Report on Teacher Quality, (U.S. Depart- 
ment of Education, 2002), stated that teach- 
er education and certification are not related 
to teacher effectiveness. Although many re- 
searchers disagree (see Darling-Hammond & 
Youngs, 2002), it remains likely that many 
of today’s teacher education programs are un- 
prepared to provide the kind of training, data 
collection and support to help teacher can- 
didates learn to manage the pressures of be- 
ing a classroom teacher in the 21" century 
(Wise & Liebbrand, 2000). 

Beginning in 2000, Colleges of Educa- 
tion accredited by The National Council for 
Accreditation of Teacher Education (N CA- 
TE) must provide multiple samples of reli- 
able and valid evidence that their teacher 
candidates in regular and special education 
have mastery of content knowledge in their 
respective fields, pedagogical knowledge and 
the effect of the instruction of teacher can- 
didates on student learning. NCATE re- 
quires teacher training programs to assess the 
effectiveness of their programs and use that 
information to improve aspects of their pro- 
grams. Teacher training programs are ex- 
pected to set benchmarks for acceptable 
teacher performance. 

Although evidence of grade point aver- 
ages, Graduate Record Exam scores, portfo- 
lios, lesson plans, written reflections, and 
videos of classroom performance are accepted 
by NCATE as evidence of teaching expertise, 
as are data on state licensing exam scores, 
employer evaluations, and placement rates. 
These NCATE suggestions provide few mea- 
surements of actual teacher performance. 
Only the videotape sample can show demon- 


strable evidence that the teacher candidate 
can actually teach. Further, the No Child 
Left Behind Act (2001) requires teacher ed- 
ucation programs to file formal reports sum- 
marizing teacher test results for teacher can- 
didates graduating from their programs. 
These summary data must also be shared 
with the public, and states are required to 
rank order teacher education programs based 
on these data. 

Many Colleges of Education have few al- 
ternatives for assessment of teaching perfor- 
mance. Indeed, most schools of education 
have yet to design assessments of actual 
teaching performance that outline acceptable 
and unacceptable performance levels (Wise 
& Liebbrand, 2000). In other words, NCA- 
TE guidelines come up short when helping 
us answer the question, “Can this teacher 
candidate effectively teach?” The evidence 
considered acceptable to NCATE may focus 
more heavily on evidence of “teacher quali- 
ty,” rather than “teaching quality.” Yet, how 
well a teacher candidate teaches is critical. 
The quality of teacher preparation can ac- 
count for 40%-60% of the total variance in 
student achievement after accounting for stu- 
dent demographics (Darling-Hammond, 
2000). 

Effective Teaching and Academic 
Achievement 

Researchers over the last three decades 
have found that academic achievement is, in 
part, a function of time spent learning the 
content area combined with the level of ac- 
tive academic responding in tasks that are di- 
rectly related to the skills that will ultimately 
be assessed as evidence of academic achieve- 
ment (Greenwood, Carta, Kamps, & Arrea- 
ga-Mayer, 1990). There is a clear correlation 
between academic gain and academic re- 
sponding in the classroom. 

Several studies have described academic 
responding specifically as reading, (both 
aloud and silently), writing, academic talk, 
and task participation (e.g., manipulating 
counters for math or using a computer 
mouse). Academic responding, defined in 
this manner, has been positively correlated 
with achievement on standardized tests (Bul- 
gren & Carta, 1993; Greenwood, 1991; 
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Greenwood et al., 1990). In 1994, Green- 
wood, Terry, Marquis and Walker provided 
evidence of a causal path between, academic 
responding, academic achievement and 
teacher instruction. Low levels of academic 
responding have been associated with school 
failure (Gooper & Speece, 1990). However, 
effective instructional practices have been 
positively correlated with engaged behavior 
(Greenwood et al., 1990) and various in- 
structional procedures have been identified as 
positively or negatively influencing academic 
responding (Greenwood, Delquadri, Stanley, 
Sasso, & Whoroton, 1981). Using the right 
tool, student academic responding is a class- 
room variable that can be observed and mea- 
sured. 

Ecobehavioral Assessment 

The Ecobehavioral Assessment 
Instrument 

An ecobehavioral assessment is a concep- 
tual system of analysis designed to measure 
behaviors in one or more environments. An 
ecobehavioral assessment focuses on alter- 
nately sampling ecological and behavioral 
variables and systematically recording them 
in close temporal sequence. Analysis can re- 
veal both sequential and concurrent interre- 
lationships between the environment and a 
person’s responses (Greenwood, Schulte, 
Dinwiddle, Kohler, & Garta, 1986). 

Using an ecobehavioral assessment tool 
that incorporates a momentary time sam- 
pling method, the effects of teachers’ choices 
for instructional methods, instructional de- 
livery, instructional arrangements, and teach- 
er-student interactions are seen in the con- 
text of what the students do (academically 
respond, manage tasks, or engage in com- 
peting behaviors). Measures of the teacher’s 
behavior and a target student’s behavior in 
the context of the classroom and instruction 
are recorded sequentially and repeatedly. The 
primary focus for ecobehavioral assessment is 
the identification of the variables surround- 
ing the presence of student academic re- 
sponding or engagement. 

Assuming academic responding is cor- 
related with achievement on standardized 
tests and assuming that we can effectively 
measure levels of academic responding in 
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students, we should be able to use an eco- 
behavioral assessment tool to capture the ef- 
fects of the instruction provided by teacher 
candidates in the same manner that we col- 
lect data on practicing teachers. Using an 
ecobehavioral assessment tool, teacher edu- 
cators in special education may have the ca- 
pability of observing teacher candidates and 
charting the covariation of student with dis- 
abilities’ behaviors in specific environments 
and in the presence of instructional stimuli. 

Ecobehavioral Assessment Tools and 
Teacher Training 

Teacher education programs are expected 
to And valid and reliable measures of teacher 
candidate performance, assess the effective- 
ness of their programs and use that infor- 
mation to improve their programs (Wise & 
Liebbrand, 2000). The incorporation of an 
ecobehavioral assessment tool as a part of the 
evaluation of preservice teacher candidates 
can provide valid and reliable data on what 
the candidates do during a teaching episode. 

Purpose 

This study was a held test of the incor- 
poration of an ecobehavioral assessment tool 
as part of the evaluation of special education 
teacher candidates’ internship evaluations. 
The purposes of the present study were to 
(a) held test the appropriateness and usability 
of an ecobehavioral assessment tool as a tool 
for assessment of teaching behaviors in teach- 
er candidates in special education; and (b) 
describe the teacher behaviors, the ecological 
and instructional arrangements used by 
teacher candidates in special education, and 
the behaviors of the randomly selected stu- 
dents they taught. 

Research Questions 

The study was guided by the following 
research questions: 

1. In what ways can ecobehavioral assess- 
ment data collected on special education 
teacher candidates during their internship 
experiences be incorporated as an assess- 
ment of their teaching behaviors? 

2. What are the ecological arrangements (in- 
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structional grouping, and tasks) used by 
the selected teacher candidates? 

3. What teacher behaviors are most com- 
monly incorporated into lessons taught 
by teacher candidates? 

4. To what extent do the behaviors of ran- 
domly selected target students represent 
the following categories: academic re- 
sponses, task management responses, and 
competing responses? 

Method 

Participants 

Participants were recruited from the pool 
of students preparing for internship in the 
fall of 2002 at an urban university in the 
southeast. Each potential participant received 
a letter describing the study and a description 
of the process for informed consent. Con- 
senting participants also completed a post- 
research survey. Thirteen special education 
teacher interns participated in this study. 
Eight of the teacher candidates were majors 
in deaf education. Five of the teacher can- 
didates were majors in exceptional student 
education. All participants were candidates in 
an initial certification degree program, re- 
ceiving either a bachelor’s or a master’s degree 
in education. One target student was ran- 
domly selected for each observation. 

Settings 

The 13 special education teacher candi- 
dates taught students with one or more dis- 
abilities in several typical special education 
settings. Five teacher candidates taught in 
public schools in the following classrooms: 
(a) varying exceptionalities (VE) resource 
room (grades 1—5), (b) self-contained severe 
emotional disturbance (grades K-3) , (c) self- 
contained severe emotional disturbance 
(grades 4/5), (d) self-contained trainable 
mentally handicapped (grades 7/8), (e) self- 
contained physically impaired (grades 3—5). 
Eight teacher candidates were observed at the 
residential school for the deaf in the follow- 
ing classrooms: (a) kindergarten, (b) early 
primary (grades 2/3) , (c) middle school spe- 
cial needs (grades 6/7/8) , and (d) high 
school classes. 


Instrument 

This study used the Mainstream Code 
for Instructional Structure and Student Ac- 
ademic Response (MS-CISSAR), one of 
three programs in the Eco-Behavioral Assess- 
ment System Software (EBASS) package de- 
veloped by Juniper Gardens Children’s Pro- 
ject (Greenwood & Shye, 1995). EBASS is 
a computer software package that includes 
three computer programs used to observe, as- 
sess, and document the effects of instruction- 
al interventions used in classroom instruction 
(Greenwood, Carta, Kamps, Terry, & De- 
Iquadri, 1994). The MS-CISSAR program 
includes 105 codes. Observers used lap- 
top computers to record data during the ob- 
servations. The MS-CISSAR program is 
based on a momentary time sampling meth- 
od of data collection divided into three 20- 
second intervals that repeat throughout the 
observation. Classroom ecology (setting, ac- 
tivity, task, physical and instructional ar- 
rangement, and teacher definition) is record- 
ed in the first 20-second interval. Teacher be- 
haviors are recorded during the second 20- 
second interval. Student behaviors are 
recorded during the third interval. 

Observations 

Because one purpose of this study was to 
field test the incorporation of the MS-CIS- 
SAR ecobehavioral assessment tool as part of 
the assessment of teaching behaviors in 
teacher candidates in special education, ob- 
servations were yoked to the schedule set by 
the university supervising teacher. All teacher 
candidates were observed three times during 
the semester of their internship. Length of 
observation ranged from 27 to 66 minutes 
(mean 38 minutes). One target student was 
randomly selected for observation during 
each visit. Each target student was chosen for 
the observation by using a table of random 
numbers. Observers recorded only the gen- 
der of the student, the grade of the student, 
the student’s classroom, and whether or not 
the student was from an obvious minority 
culture. The identity of the target student 
was revealed to the preservice teacher intern 
at the end of the observation. No other in- 
formation was collected on the target stu- 
dents. 
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Reliability 

Training 

The second author and one observer col- 
lected the data. The second author previous- 
ly completed a three-day training provided 
by a trainer from the Juniper Gardens Chil- 
dren’s Project, the developers of the EBASS 
software and has conducted two studies us- 
ing MS-CISSAR. 

Observer training proceeded in two stag- 
es. In the first stage of training the second 
observer memorized the MS-ClSSAR codes 
and with the second author, practiced coding 
by watching videotapes of teachers in class- 
rooms serving students with disabilities. Us- 
ing the videotapes of teachers and students, 
the second observer and the second author 
achieved interobserver agreement across all 
categories at a minimum of 80%. The sec- 
ond stage of training occurred in a classroom 
at the residential school for the deaf not used 
for this research study. The third author and 
the data collector observed the same teacher 
and the same student for at least 30 minutes 
per session. Reliability was confirmed when 
agreement across all categories was at or 
above 80% over three 30 minute sessions 
(range 80% to 100%). 

Procedures 

Classroom observations were scheduled 
over the course of one semester. Each of the 
13 teacher candidates was observed three 
times (39 observations). Each observation 
coincided with the schedule of the university 
supervising teacher. The second author, pro- 
ficient in American Sign Language, conduct- 
ed all the observations of the teacher candi- 
dates at the residential school for the deaf 
The second observer conducted all the ob- 
servations of the teacher candidates in the 
public school classrooms. Observers chose 
unobtrusive locations within the classroom. 
Interaction with the students was minimal. 

Results 

Thirteen teacher candidates were each 
observed three times during their semester of 
internship. They were observed for a total of 
1480 minutes (24.7 hours). Length of ob- 
servation ranged from 27—66 minutes (mean 
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38 minutes). Eight interns taught at the res- 
idential school for the deaf They taught stu- 
dents with and without additional disabilities 
in grades K-12. Five interns taught in either 
resource rooms or self-contained rooms. 
They taught students in grades K-5 who 
were labeled as learning disabled, trainable 
mentally handicapped, severe emotional dis- 
ordered, or physically impaired. 

Research Question 1 

1. In what ways can ecobehavioral as- 
sessment data collected on special education 
teacher candidates during their internship ex- 
periences be incorporated as an assessment of 
their teaching behaviors? 

First, the ecobehavioral assessment data 
can be accepted as evidence of teaching ex- 
perience. The Director of the Intern Field 
Office accepted the MS-CISSAR data as ev- 
idence of successful teaching for each teacher 
candidate. Second, teacher candidates can in- 
corporate the MS-CISSAR data into their 
portfolios as data. Few teacher applicants 
have a research-based data-driven assessment 
of their teaching to show to potential prin- 
cipals. Third, the data can be used to assist 
teacher candidates in improving in specific 
areas. Because this was a field test, no inter- 
vention was implemented, but it would have 
been quite easy to identify problem areas and 
provide appropriate interventions for the 
candidates based on the MS-CISSAR data. 
Fourth, while the university forms call for a 
more global look at teaching, the MS-CIS- 
SAR data provided a data-driven description 
of the moment-by-moment events that oc- 
curred during the observation. 

Research Question 2 

What are the ecological arrangements 
(instructional grouping and tasks) used by 
the selected teacher candidates? 

Teachers instruct students in various 
configurations. This is referred to as “instruc- 
tional grouping” in the MS-CISSAR pro- 
gram. When teachers call small groups to 
work on the floor in the front of the room 
or call students to bring their chairs and 
form a circle near the calendar, the physical 
arrangement of desks remains the same, but 
the instructional grouping of the students 
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Table 1. Mean Instructional Groupings 


Instructional Grouping 

Mean Percent 

Whole Class 

59% 

Small Group 

1% 

One-on-One 

1% 

Independent 

39% 


changes. There are five codes for instruction- 
al groupings in the MS-CISSAR program: 
(a) whole class, (b) small group, (c) one-to- 
one, (d) independent and (e) no instruction. 
The preservice teacher candidates in the pres- 
ent study favored two instructional arrange- 
ments: whole class and independent. As 
shown in Table 1, teacher candidates used a 
whole class instructional arrangement an av- 
erage of 59% of the time and independent 
workstations an average of 39% of the time. 
They used small group and one-to-one in- 
struction rarely. 

Research Question 3 

What teacher behaviors are most com- 
monly incorporated into lessons taught by 
teacher candidates? 

There are nearly 30 teacher behaviors re- 
corded every cycle in the MS-CISSAR pro- 
gram. Teachers either talk about academics, 
management, or discipline. Each category of 
academics, management, and discipline has 
three subcategories: (a) command, (b) ques- 
tion, and (c) talk. For ease of data collection, 
the three subcategories of command, ques- 
tion, and talk were collapsed into the cate- 
gory of teacher talk. If, for example, a teacher 
disciplined a student and commanded her to 
sit down, we coded that command as disci- 
pline talk. Similarly, if a teacher asked a stu- 
dent an academic question, we coded the ac- 
ademic question as academic talk. Other 
codes for teacher behaviors include nonver- 
bal prompting, paying attention, reading out 
loud, singing, and not responding. Observers 
also recorded whether or not the teacher in- 
dicated approval, disapproval, or neither; the 
focus of the teacher’s attention; and the po- 
sition of the teacher relative to the target stu- 
dent. 

As shown in Table 2, the teacher can- 
didates spent an average of 46% of their time 


Table 2. Mean Special Education Teacher 
Candidates Behaviors 


Teacher Candidates Behaviors 

Mean Percent 

Academic Talk 

46% 

Attention 

15% 

Nonverbal Prompts 

12% 

No Response 

13% 

Talk Management 

9% 

Discipline 

4% 

Teacher Affect 

Mean Percent 

Neutral Affect 

85% 

Approval Affect 

11% 

Disapproval Affect 

4% 

Teacher Candidate Focus 

Mean Percent 

Other Students 

41% 

Target Student & Others 

31% 

Target Student 

12% 


engaged in academic talk. They attended to 
students an average of 15% of the time and 
nonverbally prompted students for an aver- 
age of 12% of the time. The remaining time 
was spent not responding (13%). Nonres- 
ponding is recorded when teachers are mon- 
itoring student work or when there are no 
questions. Nonresponding occurred most of- 
ten during independent work time. The 
teacher candidates spent an average of 9% in 
management talk and 4% of their time dis- 
ciplining students. (Management talk and 
discipline are different. Management talk re- 
fers to statements that assist the students in 
preparing to work, such as instructing stu- 
dents to gather their materials and meet in 
the front of the room; taking the lunch mon- 
ey to the office, etc.) 

The teacher candidates demonstrated a 
neutral affect for an average of 85% of the 
time. A neutral affect is coded when the 
teacher candidate is not engaged in approval 
or disapproval. Much of teaching at each lev- 
el is performed with a neutral affect. As 
shown in Table 2, teacher candidates indi- 
cated approval toward student behaviors (ac- 
ademic or otherwise) for an average of 11% 
of the time and disapproval toward student 
behaviors for an average of 4% of the time. 
Teacher candidates focused on students other 
than the target student for an average of 41% 
of the time and both the target and other 
students for an average of 31% of the time. 
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Table 3- Mean Academic Responses and 
Task Management Student Responses 


Academic Responses 

Mean Percent 

Writing 

15% 

Reading Silently 

11% 

Talk Academic 

8% 

Task Participation 

7% 

Reading Aloud 

<1% 

Total 

42% 

Task Management Responses 

Mean Percent 

Attention 

32% 

Move 

6% 

Manipulating Materials 

5% 

Hand Raise 

4% 

Talk Management 

<1% 

Play Appropriate 

<1% 

Total 

47% 


The target student was the sole focus of at- 
tention for an average of 12% of the time. 

Research Question 4 

To what extent do the behaviors of ran- 
domly selected target students represent the 
following categories: academic responses, 
task management responses, and competing 
responses? 

The randomly selected students engaged 
in three different kinds of behaviors: academ- 
ic responses, task management, and compet- 
ing behaviors. 

Academic Responses 

There are five MS-CISSAR codes for ac- 
ademic responses: (a) writing, (b) task par- 
ticipation (i.e., using math manipulatives or 
typing), (c) reading aloud, (d) reading si- 
lently, and (e) talking about academics. As 
shown in Table 3, the randomly selected stu- 
dents in the classes taught by teacher candi- 
dates engaged in academic responding for an 
average of 42%. They wrote for 15% of the 
time, read silently for 11%, talked about ac- 
ademics for 8% of the time and participated 
in tasks for 7%. They read aloud for less than 
1% of the time. 

Task Management Responses 

Task management responses get the stu- 
dent ready to engage in academic respond- 
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Table 4. Mean Competing Student 
Behaviors 


Competing Behaviors 

Mean 

Aggression 

0% 

Disruption 

2% 

Inappropriate Talk 

2% 

Looking Around 

14% 

Noncompliance 

0% 

Self-Stimulation 

0% 

Self-Abuse 

0% 

Total 

18% 


ing. Task management responses include (a) 
hand raising, (b) playing appropriately in 
teacher-sanctioned games, (c) manipulating 
materials (i.e., sharpening a pencil, gathering 
materials), (d) moving from one place to an- 
other, (e) talking about management issues 
(i.e., borrowing materials, talking about lin- 
ing up), and (f) paying attention. 

As seen in Table 3, the target students 
engaged in task management responses for 
an average of 47%. Students engaged in pas- 
sive attention for an average of 32%. Stu- 
dents moved from one place to another for 
an average of 6%. They manipulated mate- 
rials for 5% of the time and raised their 
hands 4% of the time. Playing appropriately 
and talking about management issues were 
recorded at less than 1% each. 

Competing Behaviors 

There are seven behaviors that compete 
with academic responding: (a) aggression, (b) 
disruption, (c) inappropriate talk, (d) looking 
around, (e) noncompliance, (f) self-stimula- 
tion, and (g) self-abuse. 

As seen in Table 3, the target students 
engaged in competing behaviors for an av- 
erage of 18%. The competing behavior most 
common to students was looking around. 
Students looked around for an average of 
14%. Target students talked inappropriately 
and engaged in disruptive behaviors each for 
an average of 2%. 

Limitations 

The utility of these findings is limited. 
First, the sample was a small sample of con- 
venience linked to two preservice special ed- 
ucation teacher preparation programs in one 
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university. This limits the generality of the 
findings beyond this project. Second, the 
presence of observers may have affected the 
behaviors of the teacher candidates and the 
students. All observations were scheduled 
ahead of time. 

Discussion 

In this field study we attempted to assess 
viability of incorporating the data gathered 
by the MS-CISSAR ecobehavioral assessment 
tool as acceptable evidence of the teaching 
behaviors of teacher candidates in special ed- 
ucation. We additionally investigated the ac- 
ademic, task management, and competing 
behaviors of randomly selected students in 
their classrooms. The MS-CISSAR ecobe- 
havioral assessment computer program was 
used to collect 24.7 hours of observational 
data on the instructional arrangements used 
by 13 special education teacher candidates, 
their teaching behaviors, and the academic 
responding, task management, and compet- 
ing behaviors of randomly selected target stu- 
dents in the classes they taught. 

Researchers have identified a causal path 
between instruction, student academic re- 
sponding and academic achievement (Green- 
wood, Terry, et ah, 1994). Although there are 
numerous variables inherent in the teaching/ 
learning process, some behaviors and non- 
academic skills contribute more to academic 
success (see DiPerna, Volpe, & Elliott, 
2002). One instructional variable that is al- 
terable is “academic responding.” Measure- 
ment of student academic responding in the 
presence of instruction by teacher candidates 
provides a data-driven snapshot of their 
teaching behaviors, their strengths in teach- 
ing and areas for improvement. 

Incorporating MS-CISSAR: The Teacher 
Trainer’s Perspective 

To prepare teacher candidates to use this 
as a meaningful tool, we provided two sem- 
inar sessions designed to familiarize teacher 
candidates with the literature on academic 
responding and strategies for interpreting the 
data they would receive. The integration of 
the MS-CISSAR in the traditional assess- 
ment process of teacher candidates presented 
few difficulties in providing meaningful feed- 


back after each formal observation. Once the 
data are collected by the University Super- 
visor, several of the problems faced by the 
researchers in this study will resolve them- 
selves. For example, the study required the 
presence of a second observer. Once univer- 
sity personnel are trained in the MS-CIS- 
SAR, program the data will be collected by 
one person. The start and stop times for each 
observation had to be coordinated. Although 
each feedback session was conducted within 
the same time frame of typical post confer- 
ences, both university supervisors and teach- 
er candidates sometimes felt time constraints 
to adequately discuss all data. However, 
teacher candidates were encouraged to review 
all data on their own and later contact the 
University Supervisor if they needed further 
clarifications. 

The benefits of the MS-CISSAR infor- 
mation outweighed the temporary challeng- 
es. During the post conference, each special 
education teacher candidate was able to im- 
mediately see, in graphed form, the results of 
the data collection. For example, it was easy 
to see how much time was spent in teaching 
vs. managing student behaviors or disciplin- 
ing students. Teacher candidates could see 
how often the target student was academi- 
cally responding and identify which behav- 
iors competed for the teacher candidates at- 
tention. As a supplement to each conference, 
each teacher candidate received a paper copy 
of the graphs and a teacher report. University 
supervisors noted that the conferences took 
on a new data-driven focus. Coupled with 
objective feedback in the form of frequencies 
and percentages, along with subjective feed- 
back based on impressions of overall perfor- 
mance, each teacher candidate was provided 
with both a macro and micro view of the 
teaching episode. 

Incorporating MS-CISSAR: The Teacher 
Candidate’s Perspective 

A post internship survey was adminis- 
tered to all 13 participants after all require- 
ments for the internship were completed and 
the final grades were issued. The survey in- 
strument (see appendix 1) asked 9 questions 
and was designed to gather teacher candidate 
feedback on the effects of the MS-CISSAR 
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data on their teaching and what they learned 
from the additional data. The second ques- 
tion on the survey asked teacher candidates 
to “describe the effect, if any, that the data 
had on your teaching.” One of the teacher 
candidates responded by saying that “the 
data helped me realize what areas I needed 
to improve on and [in] what areas [where] I 
was right on target.” Another teacher can- 
didate, responding to the same question, in- 
dicated that “the data helped me a lot. It 
showed me what areas that I needed to work 
on to better teach my class.” Overall, the sur- 
vey results indicated that the process of using 
the MS-CISSAR data, and the data them- 
selves, gave teacher candidates a clearer pic- 
ture of behaviors that did and did not occur, 
either by them or their students. 

The MS-CISSAR data added an addi- 
tional layer of information and feedback that 
the teacher candidates looked forward to re- 
ceiving. Verbal feedback from the teacher 
candidates indicated that the additional data 
were not only beneficial but provided them 
with information that the typical intern eval- 
uation tools did not provide such as frequen- 
cy of interactions with specific students and 
the visual representation of their actual 
teaching behaviors. Teacher candidates also 
found it helpful to receive specific feedback 
on the behaviors of their target students dur- 
ing their instruction. 

To test the value of the MS-CISSAR 
data, the university supervisor and the data 
collector provided only the MS-CISSAR data 
on the fourth and final post-observation con- 
ference. Feedback from the teacher candi- 
dates indicated that the MS-CISSAR data 
were just as helpful as the traditional feed- 
back used during prior observation post-con- 
ferences. 

Ecological Arrangements 

Of the five possible instructional ar- 
rangements (i.e., whole group, small group, 
one-to-one, independent, and no instruc- 
tion), the teacher candidates relied on two 
instructional arrangements: whole group 
(59%) and independent work stations 
(39%). Although whole group instruction is 
commonly used in smaller classes of 7—12 
students, it is also associated with lower levels 
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of academic responding (e.g.. Greenwood, 
Delquadri, Stanley, Terry, & Hall, 1985; 
Greenwood, Horton, & Utley, 2002). Reli- 
ance on independent and one-to-one group- 
ing arrangements can lead to higher levels of 
academic responding (Greenwood, Horton, 
& Utley, 2002; Woolsey, 2001). There were 
no recorded instances of peer tutoring or co- 
operative group work. It is possible the in- 
structional arrangements used by the teacher 
candidates in the present study may have 
been a function of candidates’ desire to dem- 
onstrate their ability to teach. In future stud- 
ies, university supervisors may use similar 
data to help teacher candidates develop skills 
in specific areas. 

Instructional Behaviors 

The teaching behaviors found in the 
teacher candidates were similar to the teach- 
ing behaviors demonstrated by teachers in 
other studies. This is both good news and 
bad news for the teacher candidates and the 
teacher educators. 

The teacher candidates spent an average 
of 43% of their time engaged in academic 
questions, commands, or talk. The good 
news is this figure is somewhat higher than 
the amount of time in-service teachers spent 
in the same behaviors in other studies with 
elementary and middle school students as 
subjects (e.g., Kamps et ah, 1991; Thurlow, 
Ysseldyke, Graden, Algozzine, 1984; Wal- 
lace, Anderson, & Barholomay, 2001; Wool- 
sey, 2001). 

Although the teaching behaviors found 
in the teacher candidates were within ranges 
found in other studies, the bad news is that 
the levels could be significantly improved. 
One limitation to the MS-CISSAR program 
is the lack of descriptors for specific kinds of 
teaching behaviors. For example, there is no 
way to record whether or not a teacher is 
asking a higher level thinking questions. The 
question is simply recorded as a question. 
This is an area where the university super- 
visor’s observational report benefits the stu- 
dent significantly. 

If teacher candidates and teachers are 
looking to incorporate strategies that increase 
the academic responding of students during 
teacher-led lecture and discussion there are 
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several research-based, low-tech, low-cost 
strategies that can increase the levels of stu- 
dent responding during whole class or small 
group instruction (Reward, 1994). Students 
can respond to yes/no or true/false questions 
with pre-printed response cards or write their 
answers on white boards. In a teacher-led 
discussion, the teacher poses a question and 
instead of one student answering at a time, 
each student in the class answers each ques- 
tion each time. When each student answers 
each question there is little doubt when stu- 
dents do or do not understand the material. 

Student Behaviors 

During the observations of the teacher 
candidates, the randomly selected target stu- 
dents engaged in more task management ac- 
tivities (47%) than academic responding be- 
haviors (42%). This is another example of 
good news/bad news. The good news is that 
the randomly selected target students spent 
about as much time in task management ac- 
tivities as did students in classes with inser- 
vice teachers. In their study of students with 
and without disabilities in three elementary 
magnet schools. Greenwood et ah, (2002) 
found that students spent more time in ac- 
ademic responding (46%) than they did in 
task management responses (42%). Both 
higher and lower percentages of academic re- 
sponding have been recorded in other stud- 
ies. 

The bad news is that passive attention 
and the other activities in task management 
are not correlated with academic achieve- 
ment (Greenwood, Delquadri et ah, 1984; 
Greenwood, Hart, Walker, & Risley, 1994). 
The more time students spend in task man- 
agement activities, less time is available for 
academic responding. 

Perhaps equally as bad were the levels of 
competing behaviors. The target students 
spent 14% of their time looking around and 
4% of their time engaged in other competing 
behaviors. This level is higher than levels re- 
ported in other studies but may be explained 
by the level of classroom management com- 
petence of the teacher candidates and the ad- 
dition of two observers. 


Conclusion 

We began this article by reviewing the 
pressures of accountability on teachers and 
teacher educators. While we are keenly aware 
that qualified teachers have a significant im- 
pact on student learning and that the quality 
of teacher preparation can account for 
40%— 60% of the variance in achievement af- 
ter figuring for student demographics (Dar- 
ling-Hammond, 2000), it is also true that 
many teacher preparation programs lack as- 
sessments of actual teaching performance 
(Wise & Liebbrand, 2000). Many teacher 
preparation programs struggle with the pro- 
vision of substantial evidence to answer this 
question: “Gan this teacher candidate effec- 
tively teach?” 

Although our special education teacher 
preparation program still grapples with 
NGATE requirements and accountability 
standards, the MS-GISSAR data provided us 
and our teacher candidates with a data-driv- 
en profile of their teaching behaviors and the 
classroom responses of three students in their 
classroom. The data gathered through MS- 
GISSAR were objective and concise. We were 
able to compare teacher candidate perfor- 
mance to inservice teacher performances. 
Additionally we were able to compare stu- 
dent behaviors in the presence of teacher 
candidates to student behaviors in the pres- 
ence of inservice teachers. 

The training process for the MS-GIS- 
SAR program takes approximately 30 hours. 
The investment is worth the effort. The MS- 
GISSAR data were accepted as evidence of 
teaching. The teacher candidates appreciated 
the addition of data during their post-con- 
ferences. The MS-GISSAR data pointed to 
areas of strengths and weaknesses in teacher 
candidates that, in future studies, can lead to 
interventions. The MS-GISSAR program is 
flexible. Teacher candidates could be ob- 
served with this program during their field 
experiences and at several points during their 
internship. This kind of data-timeline could 
clearly demonstrate that the teacher candi- 
date in question can, indeed, effectively 
teach. 
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Appendix 

Post Internship Survey for An 
Ecobehavioral Assessment of the 
Teaching Behaviors of Teacher 
candidates Serving De Students and 
Students with varying Exceptionalities 

Please respond to each of the 9 questions below. 
Your response will remain confidential. 

Please indicate if you were a: 

(a) Deaf Education Intern or a Varying Ex- 

ceptionalities Intern 

(b) male or female 

(c) minority 

1. Describe the effect, if any, of having additional 
people observe you during the regularly sched- 
uled observations. 

2. Describe the effect, if any, that the data had 
on your teaching. 

3. Describe the effect, if any, that the data had 
on the behavior of your students. 

4. Describe the effect, if any, that the meetings 
with your intern supervisors had on your 
teaching. 

5. As a result of participating in this study, what 
do you know now that you didn’t know before 
about teaching and learning? 

6. Would you recommend the use of the com- 
puter program for the evaluation of instruction 
for future interns? Why/why not? 

7. If you could repeat your internship experience 
and be observed, what would you do differ- 
ently? 

8. What kinds of information do you think 
teacher interns need? 

9. What information would you like the research- 
ers to know? 
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